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FOREWORD 


This report aims to serve two purposes* First, it compiles and 
documents the methods, techniques, and data sources that can be used to 
estimate the investment costs of the electronic data processing equip¬ 
ment of Command and Control systems* As such, the report is addressed 
to the practicing cost estimator* Second, this document is addressed to 
those concerned with developing new cost-estimating methodology. In 
this capacity, it presents a format whereby the estimating guidance pro¬ 
vided in Chapter 6 of Air Force Manual AFSCL 173-1 (Cost Estimating Pro¬ 
cedures)^] may be applied to estimate the cost of particular items of 
the Program-Work Breakdown Structure (WBS) (Attachment 1) of the manual. 
It is believed that similar item-oriented guidance can and should be de¬ 
veloped to cover the major "Levels 3, 4, 5, and 6” items of the refer¬ 
enced Structure. For instance, the typical Level 5 items that might be 
similarly documented are: radar, sensors, computer programming, data 
display, and communications subsystems of command and control systems; 
the airframe, propulsion, flight control, navigation aids, and communi¬ 
cation subsystems of aircraft systems; space vehicles and re-entry ve¬ 
hicles of space systems; ballistic missile vehicles, training, AGE, and 
engineering and management of missile systems. 

The major thesis of this report is that there are normally several 
different methods of estimating the costs of any given major Air Force 
system item, such as EDP equipment. This report describes each of these 
basic estimating methods, and it discusses under what conditions one 
method is to be preferred to another. 

Many people have generously contributed their specialized knowledge 
of EDP equipment and its cost estimation during the preparation of this 
document. The writer is especially indebted to his colleagues in MITRE's 
Department D-53 (Systems Analysis) and D-84 (Applied Mathematical Anal¬ 
ysis) and to personnel in the Cost Analysis Division of the Air Force*s 
Electronic Systems Division. 


REVIEW AND APPROVAL 

This technical report has been reviewed and is approved. 



KENNETH K. WALLICK, Lt. Colonel, USAF 
Chief, Cost Analysis Division Comptroller 
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ABSTRACT 


This document seeks to provide practical guidance to ana¬ 
lysts charged with estimating the investment costs of 
the electronic data processing equipment of Air Force 
Command and Control systems. The document is also of¬ 
fered as a methodological prototype for writing similar 
item-oriented reports on other major items of Air Force 
systems, such as communications equipment, radar, sen¬ 
sors, display equipment, computer programming, and the 
major subsystems of aircraft, ballistic missiles, and 
space systems. 
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SECTION I 


INTRODUCTION 


DEFINITION 

The glossary included in Attachment 1 of the AFSCL 173-1 ^ does 
not define the term. Electronic Data Processing Equipment (EDP). As a 
matter of fact, it is not easy to define the term simply or to every¬ 
one's satisfaction. One of the problems in definition is in selecting 
the point of demarcation between EDP equipment and the sensor and com¬ 
munication systems which record and transmit information to the EDP sub¬ 
system proper and between the data display systems which make the pro¬ 
cessed data available in usable form to the manager, decision maker, 
military planner, design engineer, and other users. Historically, the 
term "EDP equipment" has not been defined consistently from one cost 
study to another. 

This report will not attempt to resolve the definition issue; ac¬ 
tually, the content of the report has not been geared to any single 
definition of the term. However, because it is necessary to have a 
general bench mark, EDP equipment is defined to comply with the classi¬ 
fication scheme contained in the Work Breakdown Structure (WBS) (Attach¬ 
ment 2 of AFSCL 173-1 [}] ). Under this classification, EDP equipment 
is established as one of the six major item categories of prime mission 
equipment of a Command and Control system. The other five are: radar, 
other sensors, computer programming, communications, and data displays. 
Actually, computer programming, is not an equipment item. 

The WBS, in turn, subdivides EDP into four major subclasses: the 
central processor, large capacity storage, data channels, and input/out¬ 
put equipment. A fifth "catch-all" classification, "other," picks up 
such items as certain instruction controls and arithmetic elements that 
do not always fall conveniently into one of the four major classes. 
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SCOPE OF COSTS COVERED 

Only investment or production costs of EDP equipment are discussed 
in this report. Excluded from this study are: 

(a) the RDT & E costs entailed in bringing a new item of equipment 
from concept to the point of specification; 

(b) the development and investment costs of computer programs to 
be used with the EDP equipment; 

(c) the non-production investment costs associated with the EDP 
equipment such as the costs of installing the equipment and 
the initial training of personnel to operate the equipment; 
and 

(d) the annual costs of operating and maintaining the equipment 
once it has been acquired. 

MAGNITUDE OF EDP COSTS 

Historically, EDP equipment has represented a major item of cost 
in most Air Force Command and Control systems. The specific magnitude, 
however, has varied greatly from system to system. Ignoring the upper 
and lower extremes, EDP equipment costs have generally ranged from 10 
percent to 20 percent of total investment costs for most Air Force Com¬ 
mand and Control systems. 

In most cases, the central processor has been the most costly item 
of total EDP equipment. Although the situation may vary substantially 
from case to case, the cost of the central processor has composed roughly 
one-half of total EDP investment costs. The other three major items, 
large capacity storage, data channels, and input/output equipment, con¬ 
stitute the remaining 50 percent. 
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GENERAL PLAN OF THE REPORT 


Four basic methods of estimating EDP investment costs are discussed 
in this report. The advantages and limitations of each method are dis¬ 
cussed, and specific data sources that might be referenced in using each 
method are identified. First, publicly available catalogs are used to 
a greater extent in costing EDP equipment than they are used in most 
other major classes of electronic equipment. Second, analogies are 
widely used in costing EDP equipment just as they are used in costing 
other items of equipment. In other words, the cost of the EDP equip¬ 
ment of a new system is frequently based on the costs of similar equip¬ 
ment in other prior systems. Third, relatively extensive research has 
gone into the development of parametric-estimating relationships (ERs) 
as a means of estimating EDP costs. These ERs will be reviewed. Fi¬ 
nally, the paper discusses how the cost estimator can use the help of 
EDP experts in estimating the investment costs of new EDP equipment. 
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SECTION II 


EDP CATALOGS 


TYPES OF CATALOG INFORMATION 

Publicly available catalog compendiums provide an extensive array 
of cost and performance-design data on EDP equipment. These catalogs 
generally contain the per unit prices for numerous manufacturers' models 
of EDP equipment. 

WHEN CATALOGS CAN BE USED 

These catalogs can be used to estimate EDP costs when the equipment 
to be costed is a standard, off-the-shelf commercial item, and when the 
office requesting the cost estimate or the system design engineer with 
whom the cost estimator is working can identify the specific manufac¬ 
turers' EDP model to be costed. This specific type of equipment des¬ 
cription information is likely to be available during Contract Defini¬ 
tion (i.e., Definition Phase) or the Acquisition Phase of a System Cycle. 
Frequently, it will not be known during Concept Formulation (i.e., in 
the Conceptual Phase). 

Although primarily applicable to costing state-of-the-art equip¬ 
ment, catalog prices can also be used as a starting point for costing 
new types of EDP equipment, which are similar to but slightly more 
complex or advanced than current manufacturers' specification models. 

The catalog price would then be a data source for using the "specific- 
analogy" method of costing discussed in Section III. 

ADVANTAGES OF CATALOG COSTING 

The catalog method of costing has the following advantages: it is 
likely to give a more accurate estimate than the Estimating Relationship 
method of estimation described in Section IV; and its credibility is 
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relatively easy to establish since its methodology and data sources 
are easily traced and verified. 

DISADVANTAGES OF CATALOG COSTING 

There are two closely allied problems associated with using the 
catalog method of estimating EDP investment costs* Frequently, the 
cost estimator cannot obtain a model or specification type description 
of the equipment to be costed. Without such a description, the cata¬ 
log method of costing cannot be used. Even when a relatively detailed 
design-type description of the desired equipment is available, there 
may be a problem in using the catalog method of costing when the equip¬ 
ment to be costed does not match any catalog item. This is often true, 
especially when the cost analysis is in support of advanced planning 
projects which require EDP equipment having performance capabilities 
exceeding the current state-of-the-art. At best, in such situations, 
the catalog method must be used in conjunction with some of the other 
estimating methods described in the following sections, 

SPECIFIC CATALOG COMPENDIUMS 

There are at least five major catalog compendiums of financial 
and non-finaneial information on EDP equipment. These are described 
in Exhibit I. 

The choice of a specific catalog source, when it is appropriate to 
use catalog costing, depends upon a host of considerations. In some 
circumstances, there is the question of availability. All cost esti¬ 
mators do not have access to all EDP catalogs. Also, some catalogs 
are easier to reference than others, and when a quick answer is re¬ 
quired, the easier-to-reference catalogs may be considered first. 
Finally, there is the question of accuracy. Accuracy requirements vary 
from case to case. Some catalog compendiums, because of their greater 
detail or more frequent updating, will give a more accurate estimate of 
EDP costs than otiver compendiums. 
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EDP Equipment Catalog Compendiums 
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EXHIBIT I (Continued) 

EDP Equipment Catalog Compendiums 
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Furnished free of charge to government agencies, Catalog #1 
(G.S.A.) provides the latest, most authoritative prices to the Govern¬ 
ment of current specification computers. However, if the computer is 
to be purchased by a government contractor, rather than directly by the 
Government, GSA prices will probably understate the correct price. 

The eight-volume Auerbach reports cost $695 per year and contain 
more than 5,000 small print, 8-1/2" x 11" pages of detail. These re¬ 
ports are a useful reference to the cost estimator when the system de¬ 
signer can specify a highly detailed description of the EDP equipment 
configuration to be costed and when a high degree of accuracy in the 
cost estimate is required. Among the major advantages of the Auerbach 
reports is that they summarize and consolidate the many thousands of 
pages contained in the equipment catalogs of different EDP equipment 
manufacturers. The Auerbach reports also seek to evaluate and rate 
objectively the comparative capability of different manufacturers' 
equipment to perform specified EDP tasks. For many costing assignments, 
however, the cost estimator can work at a higher level of aggregation 
than that provided by the Auerbach reports. 

The major advantage of the Adams Associates catalog is its compact, 
easy-to-reference format. For instance, the vest-pocket edition of 
Adams catalog is small enough to fit into a man's shirt pocket and 
sells for $10 per year for four quarterly issues. It gives the costs 
and major performance-design parameters of representative configura¬ 
tions of about 200 business and scientific computers. The costs are 
expressed as monthly rentals, which can generally be converted to 
approximate purchase prices by multiplying the monthly rentals by a 
factor between 40 and 50; the exact figure depends upon manufacturer, 
model 5 and type of machine. However, the range of costs for a basic 
computer reported by Adams are, typically, fairly wide because total 
EDP equipment costs depend so importantly on the specific equipment 
configuration involved. Hence, when specific EDP configuration des- 
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criptions are available, the G.S.A. or other, more detailed catalogs 
should be used. 

The Department of Army catalogs (sources 2 and 3, Exhibit I) are 
much more detailed than the Adams and much less detailed than the Auer¬ 
bach catalogs. The standard comparative tables which are provided by 
the Army catalogs, cover both current and superseded computers, and 
they furnish a good basis for parametric cost studies requiring a broad, 
historical coverage of performance, design, and cost characteristics. 
The fact that these documents are available without charge to qualified 
requestors through the Defense Document Center or the Clearing House 
for Federal Scientific and Technical Information makes them accessible 
to practically all estimators who need EDP cost data. An indefinite 
updating schedule is one drawback of the Army catalogs. There was no 
1965 edition, and apparently none is definitely scheduled beyond the 
1964 edition. 

In addition to the catalogs referenced above, a number of trade 
magazines, such as Computers and Automation , Business Automation, 
Electronic News , Datamation , etcperiodically provide catalog-type 
cost and specification information on major computers. 
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SECTION III 


ANALOGOUS EDP APPLICATIONS 


DEFINITION 

Sometimes, a cost estimator will base his estimate of the costs of 
the EDP equipment of a new system on the costs of closely analogous or 
identical EDP equipment used in some other system(s). These costs from 
analogous systems may take the form of contractor actuals or of contrac¬ 
tor or Air Force estimates for such analogous equipment. 

WHEN USED 

Analogies are useful as a basis for estimating EDP equipment costs 
under several circumstances: 

(a) One instance would be when the new computer to be costed is a 
military specification computer or a militarized version of a 
standard, commercial computer for which there is no standard 
catalog price. 

(b) In some advanced planning or conceptual phase studies, system 
design engineers may not be in a position to specify a partic¬ 
ular manufacturer's model as being the one desired. Occasion¬ 
ally, the engineers may not even be able to specify the gen¬ 
eral performance requirements (storage capacity, processing 
speed, etc.) desired of the new computer. Sometimes, the only 
guidance that the project engineers can give the cost estima¬ 
tor is to liken the type of EDP functions to be performed and 
the general magnitude of the EDP workload for the new system 
to those in another specified system. In such instances, the 
cost estimator's only basis for estimating the EDP costs of 
the new system is to try to determine what were (have been) 
the EDP equipment costs of the specified analogous system. 
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LIMITATIONS 


There are several problems in using analogies as an estimating 
basis. First, no two EDP applications are identical. Sometimes, the 
analogies suggested by the project engineers, although the best immedi¬ 
ately available, may prove to be remote. Even if the engineering as¬ 
pects of the EDP equipment of the new and old systems are similar, the 
resource requirements may be vastly different. For instance, the first 
application may have been plagued by cost-inducing engineering changes 
that are not likely to occur in later applications. Stated more gener¬ 
ally, as equipment evolves from one production level or time period to 
another, learning curve or price level changes may necessitate major 
revisions in per unit EDP equipment costs. 


Second, it is frequently difficult for the cost analyst to obtain 
reliable costs on the analogous EDP application. Very often, the only 
costs obtainable on the analogous application are estimated costs as 
opposed to actual costs. There are several reasons for this. First, 
historically, on many contracts the Air Force has not received item-by- 
item breakdowns of contractor actuals. (Under the new AFSCL 173-2 Cost 
Information System, item-by-item breakdowns of contractor actuals may 
be provided more frequently than in the past.) Second, when the item 
cost actuals do become available, they are often treated as highly 
proprietary and are not available to cost estimators at all echelons 
and in all organizations. Third, it is sometimes hard to evaluate the 
validity and applicability of the item cost actuals reported. For in¬ 
stance, the term, "EDP investment cost," is not always defined in the 
same way by a contractor as it is by an Air Force cost analyst. 

Thus, because actual cost data are often hard to obtain, the spe¬ 
cific analogy method of estimation, historically, has often involved 
using a prior cost estimate as a base to make a future cost estimate. 
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This procedure is hazardous simply because, historically, many prior 
estimates have been seriously in error.* 

PINPOINTING SIMILARITIES AND DIFFERENCES 

Notwithstanding the problems in using the specific analogy method 
of estimation, it is very frequently used by cost estimators since the 
problems in using other estimating methods are often even more difficult. 
There are various data sources that can be employed in using the spe¬ 
cific analogy method to estimate EDP investment costs. 

MITRE has made studies which can aid the cost estimator in deter¬ 
mining how similar a new EDP equipment requirement is as compared to 
previous or contemporary EDP equipment on which he has cost data. E 2 * ll 

These studies, which were undertaken to assist the Air Force in 
procuring EDP equipment, list among other things several hundred per¬ 
formance or design parameters of EDP equipment that may influence the 
cost as well as the effectiveness of such equipment. Illustrative of 
such parameters are: the size, access time, cycle time, etc., of the 
main memory unit of the central processor, the storage capacity, access 
time, minimum addressable record length, etc., of the intermediate ac¬ 
cess storage (disk, drum, magnetic tape). Among the more general phys¬ 
ical parameters of the total EDP equipment system are weight, cubage, 
power requirements, etc. Even more general are: ease of maintenance, 
survivability, security provisions, etc. 


* A number of studies (RAND, Peck & Sherer, etc.) have quantified this 
error. Charles J. Hitch, former Department of Defense Comptroller, 
recently stated: "There is first the problem of estimating the de¬ 
velopment and production costs of new weapon systems. The record of 
the Department over the past fifteen years has been spectacularly 
bad. We and our contractors have typically underestimated costs by 
factors of two to ten. (Not 2 to 10 percent, but 100 to 900 percent,)" 
Charles J. Hitch, Decision-Making for Defense , University of Cali¬ 
fornia Press, 1965, p. 64 
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As indicated above, the referenced MITRE studies provide check¬ 
lists for systematically identifying the areas of cost-indueing differ¬ 
ences in performance and design between proposed or new EDP equipment 
and previous or contemporary EDP equipment. 


SPECIFIC ANALOGIES 

A useful source for learning what types of EDP equipment particu¬ 
lar agencies of the Federal Government (military and non-military) are 
using, what the costs of these equipments are, where each specific item 
of EDP equipment is located geographically, and to what applications 
these equipments are being put are reported in Inventory of Automatic 
D ata Processing (ADP) Equipment in the Federal Government . M 

A useful source for finding out what types of EDP equipment the 
Air Force is currently using at specific Air Force bases and for what 
purposes or to what applications this equipment is being put is Data 
Systems Automation Program . 

A limitation of these sources is that their data is approximate 
and partial rather than precise and complete. Costs are coded in broad 
ranges; it is difficult to associate the equipment applications to par¬ 
ticular "L M systems; the geographic locations are approximate (e.g., 
MITRE’s location is stated as Framingham rather than as Bedford), and 
only the basic computer is identified rather than the full EDP config¬ 
uration . 
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SECTION IV 


COST-ESTIMATING RELATIONSHIPS 


TYPES OF CERs 

Both the Air Force and its not-for-profit technical support con¬ 
tractors have developed Cost-Estimating Relationships (CERs) that may 
be used under limited circumstances to estimate certain EDP equipment 
costs, 

These CERs are equations which provide the means for estimating 
the investment costs of a unit of EDP equipment based on the values of 
one or more of the equipment's performance parameters such as storage 
cycle time, complete add time, minimum core storage capacity, etc. 

WHEN THESE CERs MAY BE USED 

These CERs may be used to estimate EDP costs when the cost estima¬ 
tor is able to secure only a very limited description of the equipment 
that he is to cost; when he is able to learn only what the performance 
capabilities of the equipment are to be, not what it will look like, 
the nature of its design, its specification number, or the manufactur¬ 
er's model number. Usually, this limited information is likely to be 
available during a system's Concept Formulation. Limited description 
information may also be available beyond the Concept Formulation when 
the computer required is different (somewhat advanced) from any current 
specification computer. Under such circumstances, especially if the 
time available in which to make the estimate is very short, the use of 
parametric CERs may be a valuable means of getting a rough estimate of 
a new computer's cost. 

A parametric CER also can provide a quick, simple means of double¬ 
checking the estimate derived by other estimating methods. 
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LIMITATIONS OF CERs 


Since considerable research effort has been spent in developing 
parametric CERs for EDP equipment, and since even greater effort is in 
process in developing such CERs in all fields of military costs, it is 
appropriate to consider here the problems and limitations relative to 
using such CERs 

One, the relatively limited set of circumstances under which a 
parametric EDP CER is the preferred method of estimation is one of the 
severest limitations of this estimating method. Where specification 
type description information is available, a catalog price or a specific 
EDP analogy will normally provide a more accurate estimate. Where only 
task-workload type information is available, EDP CERs that have been de¬ 
veloped to date cannot be used; a specific task-workload analogy must 
be found. 

Two, even when the conditions are propitious for using parametric 
CERs, they must be used with great discretion. In the EDP field, the 
pace of technological progress is rapid, and there is a longrun trend 
of greater overall computing power per dollar spent. To cite a dramatic 
example, Diebold recently forecast that for typical ’’chip systems’' image 
files the cost per unit stored will decline from $1.00 in 1964 to $0.60 
in 1966 to $0,004 in 1973. ^ What this means is that, wherever advanced 
developments are concerned, CERs based on historical costs must be ad¬ 
justed for the longrun declining cost factor. To determine this ad¬ 
justment factor, the cost analyst should check with experts in partic¬ 
ular fields of EDP technology. 

In addition to these general precautions, several other reserva¬ 
tions should be made relative to the available parametric CERs on EDP 
equipment. First, two of the organizations (System Development Corpor¬ 
ation and RAND Corporation) that have tried to develop parametric CERs 
for EDP equipment arrived at essentially inconclusive or negative 
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findings. SDC found no consistent, reliable relationship between EDP 


cost and EDP performance parameters, whereas RAND imposed severe limita¬ 
tions on the EDP CER it developed. ^ 

Another qualification is that most EDP CERs have been based predom¬ 
inantly on general purpose computers. Frequently, however, Air Force 
Command and Control systems require special purpose computers or a 
special adaptation of general purpose computers. 

Finally, no CER covering total EDP investment costs (WBS Level 5) 
has been developed by anyone. The CERs developed to date have covered 
either the central processor or large capacity storage units. None has 
been developed covering data channels, input-output equipment, or other 
miscellaneous EDP items. 

Conceivably, it might be possible to estimate these latter three 
categories of EDP equipment as a factor or percentage of the central 
processor and large capacity storage costs. However, no one to date 
has developed such an ER. RAND, which has worked on EDP CERs, cautions 
against expectations for such cost-to-cost CERs because the peripheral 
equipment configuration varies so drastically from one EDP application 
to the next. Rapidly advancing technology also makes it difficult to 
establish any stable relationship between one type of EDP cost and an¬ 
other. For instance, Diebold estimates that between 1963 and 1973 the 

cost of the main frame and operating memory will decline from 33 percent 

[Y] 

to 21 percent of total EDP costs in a typical manufacturing plant. 
SPECIFIC CERs 

(a) AFSC (ESD) has developed two major EDP parametric CERs. 



is: 



Y = the acquisition cost of the central processor in 
c millions of dollars; 
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X 


= the speed of the equipment defined as the time, in 
microseconds, required to execute an add instruction 
or a given sequence of arithmetic or logical instruc¬ 
tions including the storage access time . 

The coefficient of correlation for the estimating equation is 

0.745, and the standard error of estimate is 0.0775. 


The second ESD EDP CER 


[ 10 ] 


is: 


Y 

c 


.8726 

1 ,734 (X) 


Y = the acquisition cost in dollars of the EDP magnetic 
core storage unit; 

X = the storage capacity of the memory unit in binary 
digits (bits) divided by 1000. 


The coefficient of correlation of the estimating equation is 
0.9752, and the standard error of estimate is 0.1020. 

The ESD CERs apply to computers bought by the Federal Govern¬ 
ment. Computers bought by military contractors would probably 
be somewhat higher in price. 

[ 8 ] 

(b) RAND has developed the following CER 
R = 0.37 + .033 (eye) + .015M ; 

R = monthly rental in thousands of dollars of the equip¬ 
ment group composed of the central processor, memory, 
and associated control modules • 

eye = the number of memory cycles per second, in thousands 
(the reciprocal of cycle time); 

M = memory core capacity in M bits. 


RAND cautions that the referenced equation does not closely 
fit the observations used to derive it, especially for smaller 
machines. The coefficient of correlation of the estimating 
equation is 0.91. 
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(c) MITRE has developed a series of eight EDP CERs as shown in 
Exhibit II.These CERs provide the basis for computing 
the cost of the computer central complex using minimum core 
storage capacity and/or complete add time as the independent 
variables. The estimating equations were derived from ob¬ 
servations taken on 15 computers in the field in 1963. 

The MITRE CERs apply to general purpose, digital computers 
having greater than 100,000 bits minimum core storage capac¬ 
ity and with a central processor cost exceeding $300,000. 

(d) The Diebold Group, Inccomputer research consultants, 
has provided a series of ERs oriented toward future 
EDP developments. The Diebold study represents an in¬ 
tensive three-year project in which 80 large U.S. and 
European corporations have participated. One of the 
Diebold summary charts is reproduced as Exhibit IV. 

These types of projected factors, which represent a 
distillation of expert opinions (see Section V), may 
be quite useful to an estimator for obtaining a "quick 
fix" on the likely financial impact of specific new 
developments in EDP technology. Two qualifications, 
however, apply to these ERs. First, the ERs have been 
formulated at a lower level of item detail than many 
Air Force cost estimators are accustomed to working. 

Second, such factors inherently have a strong subjec¬ 
tive basis and can provide, at best, only a highly 
gross estimate. 
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SECTION V 


EDP EXPERTS 

COST APPLICATIONS OF EDP EXPERTISE 

Experts in various areas of EDP technology are frequently useful 
to the cost estimator in estimating the EDP equipment costs of a new 
system. First, such experts may help the cost estimator surmise the 
design implications of a new, enhanced EDP performance requirement. 

For instance, the EDP engineer may provide an informed opinion as to 
what effect on the equipment’s size, weight, internal circuitry, etc., 
that a 100 percent increase in the data-processing rate or internal 
memory capacity would have. Second, the EDP experts may provide the 
cost estimator with an engineering estimate relative to the effect of 
changes in engineering complexity, in size, or in weight of the equip¬ 
ment on per unit EDP investment costs. 


WHEN TO USE EXPERTS 

EDP equipment experts are likely to be useful consultants to the 
cost estimator under several sets of circumstances. 

(a) When the new computer to be costed necessitates a new, complex 
development in technology over and above that embodied in any 
current specification computer, experts may provide more up- 
to-date, relevant guidance on both configuration and costs 
than that afforded in published catalog prices or parametric 
CERs based on state-of-the-art equipment. 

(b) When other methods of estimating the cost of new EDP equip¬ 
ment, such as catalog prices, parametric CERs, contractor 
actuals, or estimates on the costs of analogous equipment, 
are in sharp conflict relative to the appropriate estimated 
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cost of the new computer, a recourse to experts may help to re¬ 
solve or compromise the conflict. 

(c) When the time available in which to estimate the EDP costs is 

too short to locate and analyze catalog prices, contractor rec¬ 
ords, or parametric CERs, the estimator can often quickly ob¬ 
tain an order-of-magnitude cost estimate for the new computer 
from an expert who is in close, constant touch with the latest 
developments in the EDP field. 

LIMITATIONS 

The most frequent problem in using experts is that the cost estimar 
tor often receives little or no traceable supporting data or methodology 
to substantiate the expert's opinion. Of course, sometimes an EDP ex¬ 
pert will support his "considered" opinion with full documentation that 
traces each step of his reasoning. However, in many cases expert opin¬ 
ions are purely intuitive, and the cost estimator receives little or no 
insight relative to the process that the expert used to reach his opin¬ 
ion. The problems of evaluating such undocumented opinions are height¬ 
ened by the fact that many of the most knowledgeable computer experts 
are employed by the leading manufacturers of computer equipment. It is 
reasonable to presume that the opinions of these experts are sometimes 
slanted to reflect favorably on the computers manufactured by or being 
developed by their employers. 

Another problem in using outside experts for opinions is that pro¬ 
ject ground rules sometimes deny Air Force cost estimators access to 
contractor sources when making " independent 1 ' Air Force cost estimates. 


SOURCES OF EDP EXPERTISE 



AFSCL 173-1, (pp. 4-10 and 4-11) establishes as a longrun project 
the preparation of an "Expert Source Record" (AFSC Form 12) for all 
major items of Air Force systems. The following provides a start 
toward a "Hanscom Complex" EDP expert list: 
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(a) Air Force Sources 


1. ESD, Directorate of Technology, Computer Division 

2. ESD, EDP Equipment Office 

3. ESD } Comptroller, Cost Analysis Division (for cost data) 

(b) The MITRE Corporation 


1. Department 71, Computer & Display Technology 

2. Department 84, Applied Mathematics (for technical charac¬ 
teristics of EDP equipment affecting cost) 

3. Department 53, Systems Analysis (for cost data) 

4. Division 5, Planning Staff 

(c) Industrial Sources 


The publicly available manufacturers* catalogs plus Air Force 
contractor records provide relatively thorough guidance as to 
which companies are manufacturers of and experts for particu¬ 
lar types of computers. Air Force cost estimators have sev¬ 
eral means of identifying particular departments or individu¬ 
als within these companies as experts on particular computer 
areas. First, either of the Air Force EDP expert sources, 
identified in (a) and (b) above, can provide useful guidance 
on this matter. Second, the U.S. Organization Chart Service, 
a private quarterly publication, identifies the major depart¬ 
ments and personnel of all leading industrial companies, in¬ 
cluding EDP manufacturers. Also, private EDP evaluative or¬ 
ganizations, such as Auerbach, Diebold, and Adams Associates, 
have a good working knowledge of industrial expertise for EDP 
equipment, plus a substantial in-house capability on their 
own staffs. 
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SECTION VI 


SUMMARY 

This report has tried to show that a cost analyst who estimates 
EDP equipment costs has at his disposal a kit of estimating tools 
rather than a single method. Also, it has been stressed that none of 
the various estimating methods has an inherent, universal, clear-cut 
advantage over the others. In any given case, the preferred estimating 
method will depend upon many considerations such as: how well (how 
specifically) the EDP equipment to be costed is described; the types of 
documented data plus expert sources available to the estimator; whether 
or not a high degree of accuracy in the cost estimate is important; and 
the length of time the estimator has to make his estimate. 

Frequently, because of data inadequacies and other problems, the 
analyst will find it advantageous to use two or more methods to esti¬ 
mate EDP equipment costs, even if a second or third method is used only 
to check the results provided by the first. 

Exhibit III provides a highly simplified, generalized cost-estima¬ 
ting matrix that attempts to recap procedurally the salient features of 
this report. 

Finally, note should be made of the need for further and continuing 
work in this area of EDP cost-estimating methodology. This work should 
be of three types: 

(a) First, there is the question of normal updating. Some of the 
specific content of the report is relatively perishable. New 
catalog services, new estimating relationships, new experts, 
and new analogous EDP applications will certainly become 
available. Periodically, a document of this type should be 
revised to reflect such new information. 
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Generalized Cost-Estimating Matrix 
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f Status monitoring - 1000 weapons in "near" real-time. 
Interception - simultaneously perform 25 intercepts. 
Detection - 0.999 probability, m^ target. 















EXHIBIT IV (Continued) 
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EXHIBIT IV (Continued) 
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(b) Second, the technique and data source portions of the report 
could profitably be expanded: 

(1) Certain methodological issues recently explored in a 
generalized context should be discussed in the specific 
context of estimating EDP equipment costs, for instance: 
how should an analyst proceed when he has several more 
or less analogous EDP sources; how should he select con¬ 
sultants or experts in particular EDP areas; and how 
should he comparatively evaluate a host of heterogeneous 
EDP data sources to arrive at a final cost estimate that 
gives due consideration to all of his available informa¬ 
tion . * 

(2) A later edition of the report will expand the specific- 
analogue guidance discussed in Section III relative to 
computers used in Air Force Command and Control systems. 

(3) A later edition will also incorporate the data that will 
be collected on AFSC Forms 12, Expert Source Record, 
relative to EDP experts. 

(4) Similar item-oriented, cost-estimating guidance reports 
will be written on computer programming and on EDP equip¬ 
ment development and operating cost estimating. 

(c) Finally, a future revision of this report will include a case 
study that will illustrate in a step-by-step, real-life con¬ 
text how an analyst should use the techniques and information 
sources discussed in this report. 


* For a brief, general discussion of these issues, see: 

AFSC L 173-1, Cost Estimating Procedures, Chapter 4, Sections C and 
D; UJ and M. V. Jones, Estimating Methods and Data Sources Used in 
Costing Military Systems, MITRE TM-4263, June 1965, 33-45. 
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